Multi-Sensory Color Code Based on Sound and Scent for Visual Art Appreciation

The development of assistive technologies is improving the independent access blind and visually impaired people to visual artworks through non-visual channels. Current single modality tactile auditory approaches communicate color contents must compromise between conveying a broad palette, ease learning, suffer from limited expressiveness. In this work, we propose multi-sensory code system that uses sound scent represent colors. Melodies express each color’s hue scents saturated, light, dark dimensions for hue. collaboration with eighteen participants, evaluated identification rate achieved when using approach. Seven (39%) participants improved their rate, five (28%) remained same, six (33%) performed worse compared an audio-only alternative. then content exploration prototype proposed graphic equivalent System Usability Scale. For artwork task, integrated received score 78.61, while graphics 61.53. User feedback indicates convenience confidence participants.